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WIGHT-VISION SYSTEM FOR MOTOR VEHICLES HAVING A PARTIAL 

OPTICAL FILTER 



Field of the Invention 

The present invention relates to a night -vision system for 
motor vehicles, which includes a camera having an image sensor 
surface that is sensitive to radiation and which is configured 
5 to detect electromagnetic radiation from the near- infrared 
range . 

Background Information 

Systems for night -vision assistance are becoming more common 
in motor vehicles. Night-vision systems serve the purpose of 
10 improving the driver's vision at night, beyond the range of a 
dimmed headlight, through the use of cameras and displays or 
windshield projections. The oncoming traffic must not be 
blinded by glare as would be the case with a conventional high 
beam, which also includes light in the visible range. 

15 Night-vision assistance is achieved by utilization and 

detection of wavelength ranges that are not visible to the 
human eye. These are made accessible to the driver via 
cameras, using displays or windshield projections (for 
instance, by head -up displays) . 

20 Conventional halogen headlights (high beam and low beam) 

include both spectral components in the visible range (VIS, 
380 nm - 780 nm, cf. DIN 5030 part 2) and also in the near- 
infrared (NIR IR-A, 780 nm - 14 00 nm) . Current NIR high beam 
headlights use conventional halogen bulbs and block the 

25 visible range with the aid of optical filters. In the future, 
NIR high beam headlights based on lasers or LED's may become 
available as well. Video cameras on the basis of CCD or CMOS 
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technology have a spectral sensitivity that ranges from 
approximately 380 nm to roughly 1100 nm. That is to say, only 
the range between 780 nm and 1100 nm of the NIR-IR-A range is 
utilized. It is denoted by NIR range in the following. 

5 Various known night -vision systems utilize the non-visible 
near-infrared range (NIR range) having wavelengths of 780 to 
approximately 1100 nm. In these NIR-based, so-called active 
systems (in contrast to systems that are based on heat 
radiation of the far- infrared) the region illuminated by NIR 
10 high beam headlights of the motor vehicle is recorded as near- 
infrared image using a video camera, and is visualized to the 
driver by means of a display (conventional or head-up display) 
in order to provide night -vision assistance to the driver . 

In pure NIR systems (without VIS range utilization) , the image 
15 from the NIR region of 780 nm to approximately 1100 nm is 

merely recorded by the camera and made visible to the driver 
on a display or head-up display. Such a system is described in 
an article by Kunihiko Toyof uku et al . : "The Night View System 
using Near-Infrared Light" in SAE 2003-01-0018, p. 33 - p. 38. 
20 There, a block filter in the optical path in front of the 

image sensor (imager) completely suppresses the recording of 
the visible range (VIS range), i.e., the wavelengths between 
3 80 and 780 nm. However, in doing so, possible improvements in 
the image quality of the image regions relevant for night - 
25 vision assistance are prevented by radiation from the visible 
(VIS) range, and safety-relevant information about preceding 
vehicles, such as LED-based brake lights, which is available 
only in the visible range, is withheld from the driver. 

In addition, mixed NIR- VIS systems are known. Here, radiation 
30 both from the NIR and the VIS range is recorded and the image 
visualized on a display. The camera utilized for this purpose 
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is sensitive in a wavelength range of approximately X_low to 
X_high, X_low lying in the visible range between 380 nm and 
780 nm, and X_high lying between 780 nm and 1100 nm in the NIR 
range . 

5 One particular problem in pure NIR systems and in the combined 
NIR-VIS systems is the uneven illumination of the region 
detected via the camera. For better vision at night, it is 
mainly the visualization of the visual field beyond the low 
beam range that is of interest. The low beam range -(denoted as 

10 close range in the following) is already sufficiently 

illuminated by the low beam and thus of secondary importance, 
but it is displayed (at least partially) nevertheless so as to 
facilitate driver orientation when viewing the night vision 
image. The camera image for this range is brightly illuminated 

15 because the conventional low beam and the NIR high beam 

supplement each other. In addition, close regions are more 
highly illuminated as a matter of principle and imaged more 
brightly than more distant zones . 

Part of the limited brightness dynamics of the camera and the 
20 displays is thus **given away" because of the bright close 
range, so that dark regions, beyond the close range, for 
example (denoted as far range in the following) , are no longer 
able to be resolved as well. 

Furthermore, the driver's attention becomes increasingly drawn 
25 to the bright close range, thereby making it more difficult to 
perceive critical details in the far range. 

Dimming of areas that are brighter than desired, computer- 
implemented by software algorithms in the processing of the 
image (in pure display systems also known as image 
30 processing) , rec[uires complicated computer work and additional 
memory capacity, which increases the cost of the 
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correspondingly equipped night-vision control device. 
In basic -night-vision systems, which do not include an image- 
processing computer, such software -based postworking of the 
camera image is not possible . 

5 Overmodulations of the imager due to limited brightness 

dynamics are also no longer able to be corrected by software- 
based postprocessing. In addition, a wave length -dependent 
attenuation of the close range via software algorithms is not 
possible in gray-value cameras, and only with great effort in 
10 the case of color cameras. 

Summary 

The present invention make it possible to attenuate the 
recorded radiation on predefined partial regions of the image- 
sensor surface of the camera of the night -vision system that 

15 would otherwise be regularly exposed to undesired high 

radiation intensity, such attenuation being implementable 
without the aid of image-processing software algorithms. Since 
according to the present invention the attenuation of the 
radiation in predefined partial regions is effected by an 

20 optical filter element appropriately disposed in the optical 
path of the night-vision system, the radiation is reduced in 
the desired image regions, for example the image of the 
excessively bright close range, in particular, even prior to 
being recorded. For the purpose of the present invention, the 

25 optical path denotes the path from the illuminated object to 
the imager- For the present invention, suitable positions of 
the filter element are positions in the section immediately in 
front of and/or within the camera. 

This arrangement dispenses with costly software algorithms for 
30 image postworking in order to dim image areas that would 
normally have an undesired excessive brightness. In an 



NYOl 1184494 vl 



4 SUBSTITUTE SPECIFICATION 



uncomplicated manner, the driver's gaze is focused more on the 
image sections that are of interest for night vision 
assistance. Overmodulation of partial regions of the image- 
sensor surface is avoided, and the available brightness 
5 dynamics of the camera and display with respect to the image 
regions relevant for night -vision assistance are utilized in 
an optimal manner. 

An advantageous example embodiment of the system according to 
the present invention includes a camera, which is sensitive in 
10 a wavelength range of 380 to 1100 nm. The radiation is 

recorded both from the VIS and NIR range, which improves the 
quality of the night -vision assistance (LED brake lights and 
tail-gate lights, for example, are visible as well) . 

Another advantageous example embodiment of the night -vision 
15 system according to the present invention is the filter- 
related attenuation of the radiation of at least the area of 
the image -sensor surface on which the close range is imaged 
from the driver's perspective. 

This is the area immediately in front of the motor vehicle, 
20 which is already adequately viewable with the aid of the low 
beam from the driver's perspective. According to the present 
invention, the high brightness, caused particularly by a 
combination of low beam and NIR high beam, is thereby 
attenuated in this region of low interest in the context of 
25 night -vision assistance, which improves the night vision 
beyond the low-beam range. The driver's attention is not 
distracted by high brightness in the close range. Moreover, 
the dynamic range of the camera is utilized to better effect, 
so that dark image regions (especially in the far range) are 
30 able to be resolved more highly . 
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An advantageous further aspect of the present invention is a 
wave length -dependent filter characteristic of the optical 

m 

filter, which has a transmittance function that is 
individually adapted to the particular use of the system. For 
5 instance, the wavelength characteristic of the image sensor in 
the camera and/or the headlight may be taken into account by 
an inverse wavelength characteristic of the optical filter, 
thereby achieving a homogenous spectral sensitivity of the 
overall system across a large range of wavelengths. 

10 Due to the selection of different spectral ranges of low beam 
and NIR high beam, the attenuation of the low beam is able to 
be simplified considerably. If the spectrums of NIR high beam 
and conventional low beam are selected such that they do not 
overlap (by blocking the NIR portion with the aid of an 

15 optical filter in the low-beam headlight, for instance) , 

complete suppression of the low-beam light component in the NV 
image is possible (spectral separation) . 

Especially advantageous is a blocking of all spectral 
components beyond approximately 600 nm in the low-beam 

20 spectrum because this allows the night -vision camera to be 
configured in such a way (transmittance range of 600 nm to 
1100 nm) that LED tail lights or brake lights having a 
wavelength of 625 nm, for instance, are still able to be 
detected despite suppression of the low beam. When configuring 

25 the wavelength-dependent filter characteristic, the spectral 
reflection behavior of the street (from asphalt, for example) 
may be taken into account as well. 

The exchangeability of the optical filter constitutes an 
additional improvement. It allows a simple adaptation to 
30 different vehicle types or vehicle variants. Retrofitted 
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systems may thus be adapted to different types of vehicles in 
a simple* manner as well. 

Especially suitable for effective attenuation of radiation 
from a specific object range, such as the close range, is the 
5 positioning of the filter immediately in front of the image- 
sensor surface. An optical filter in the form of a coating on 
the image -sensor surface is an advantageous variant in this 
context because it requires no affixation device for the 
filter. As an alternative, the filter may be applied as 

10 coating on a glass cover for the image sensor (glass lid) , 

which protects the actual image sensor and its bond wires from 
damage. Alternatively, the lid itself may be embodied as 
optical filter. An integration of the filter into the lens may 
be advantageous as well. In particular, the coating of the 

15 last lens facing the imager suggests itself in this context. 

Brief Description of the Drawings 

Fig, 1 is a block diagram of an example embodiment of the 
night -vision system for motor vehicles according to the 
present invention. 

20 Fig. 2 is a schematic illustration of a cross section of a 

camera having a filter element positioned in the optical path 
of a night -vision system according to the present invention to 
attenuate radiation recorded from the close range. 

Fig. 3 is a graph to illustrate a wavelength-dependent 
25 transmittance characteristic of an example of a filter element 
utilizable according to the present invention in the optical 
path of a night -vision system. 

Fig. 4 is a schematic illustration of an example embodiment of 
an image sensor surface having a coating that acts as filter 
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according to the present invention and which is configured for 
use in a -night-vision system for motor vehicles. 

Fig. 5 is a depiction of the local intensity distribution of 
the low-beam headlight to illustrate an inverse local 
5 characteristic of an example embodiment of an optical filter 
for attenuating the close range, configured for use in a 
night-vision system for a motor vehicle. 

Detailed Description 

In the figures, identical or functionally equivalent 
10 components are denoted by matching reference numerals . 

Figure 1 shows a block diagram of an example embodiment of 
night -vision system 1 for motor vehicles according to the 
present invention. Night -vision system 1 includes a control 
unit 3, which is connected to the additional components of the 
15 system, controls the additional components and processes their 
signals and data. 

Upon activation of the night -vision system by an operating 
unit 13, control unit 3 turns on NIR high-beam headlights 5. 
These headlights 5 illuminate a spatial range in the NIR 
20 wavelength range (780 to approximately 1100 nm) in front of 

the vehicle that is similar to that of conventional high beam 
headlights. The illumination range amounts to approximately 
250 meters. 

A camera 7, which is sensitive also to the NIR range and 
25 includes a CCD or CMOS image sensor (with linear or non- linear 
intensity characteristic in each case) and has a depth of 
focus from approximately 2m to infinite, records, among 
others, the NIR radiation reflected by objects located in the 
NIR high-beam range. According to the present invention. 
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camera 7 is equipped with an optical filter element 9, which 
is positioned in the optical path of night -vision system 1 and 
attenuates the radiation on a predefined partial region of 
image-sensor surface 11 in camera 7. The image-sensor surface 
5 is a CCD or CMOS chip, for example. 

The image data recorded by camera 7 are transmitted to an 
imaging unit 15 by control unit 3. In imaging unit 15, the 
image of the camera is visualized on a display 17 for the 
driver. Display 17 is a so-called head-up display, for 
10 instance, by which the visualized image of the camera is 

reflected to a lower portion of the windshield in a manner 
that allows it to be clearly visible to the driver , 

Figure 2 shows a schematic sketch of a cross section of a 
camera 7 including a filter element 9 positioned in the 

15 optical path of a night -vision system according to the present 
invention so as to attenuate recorded radiation from close 
range 20- In the example embodiment shown in Figure 2, such a 
filter element 9 is located immediately in front of the 
partial area of the image sensor on which the close range is 

20 imaged- The dashed lines represent the marginal rays of the 
beam of rays that radiate from the front and the back end of 
close range 20. The position of the filter element is selected 
such that all rays impinging on the image sensor surface from 
the close range pass through filter element 9. The solid lines 

25 represent the main point ray of the front or rear edge point 
of the close range. The dotted lines image a specific, 
randomly selected point from the far range which, as can be 
gathered from the drawing, is not attenuated by filter element 
9. 

30 It is advantageous to have filter element 9 as close as 

possible to image-sensor surface 11 in order to obtain the 
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sharpest possible boundary between the close range image and 

the far range image with the smallest possible overlap, so 
» 

that the fewest number of rays of image points from the far 
range is projected in a filtered manner, and the highest 
5 number of rays from close range 20 is filtered by filter 9. 

The radiation from close range 2 0 recorded by camera 7 is 
projected onto an upper region of image -sensor surface 11, the 
so-called close range image region 24, via camera lens 22, 
which is shown as a lens overall. According to the present 
10 invention, filter element 9 is positioned directly in front of 
this close range image region 24. 

Filter element 9 may be made of the material/the layers of a 
conventional interference filter or adsorption filter. This 
filter 9 attenuates the radiation from close range 2 0 

15 according to its wavelength characteristic. The unfiltered 
radiation coming from the far range impinges upon the 
remaining portion of image sensor surface 11. For instance, a 
filter whose attenuation of the radiation has the inverse, 
locus -dependent characteristic of the imaging of the motor 

20 vehicle's low beam light is mounted in front of image sensor 
surface 11. However, other filter elements that cover a range 
going beyond the pure close range are conceivable as well. 
They have a locus -dependent filter characteristic, for 
instance, which orients itself on the overall intensity of the 

25 radiation recorded by camera 7 and thus not only corrects 

halation of the close range, but additionally also compensates 
for inhomogeneities in the far range by an inverse 
characteristic. A homogenous intensity of the entire visual 
range of the camera is able to be achieved in this way, so 

30 that vignetting, for example, is compensated. Filter 9, i.e., 
the filter coating, may then influence the entire imager 
surface or else only portions thereof. 
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Filter 9 may also have a wavelength-dependent transmittance 
characteristic- Furthermore, a combination of locus -dependent 
and wave length -dependent characteristic is possible. 

Figure 3 illustrates, using a graph, an example of such a 
5 wavelength-dependent transmittance or transmittance 
characteristic of the filter. 

Transmission rate T is a function over wavelength A. The 
attenuation for the visible range (380 - 780 nm) is very high 
at approximately 90%. In contrast, the suppression of 

10 radiation in the NIR range (780 - 1100 nm) amounts only to 4%. 
A combination of the locus -dependent characteristic with a 
wavelength-dependent transmittance characteristic is 
advantageous also for achieving a likewise high attenuation of 
the NIR radiation from the close range and an equally 

15 satisfactory transmittance of VIS and NIR radiation for the 
remaining image -sensor surface area. 

Figure 4 illustrates an example embodiment of an image-sensor 
surface 11, which is coated with an optical filter according 
to the present invention and configured for use in a night - 

20 vision system for motor vehicles- Image-sensor surface 11 has 
a coating that attenuates the radiation impinging thereon only 
for a partial region 24 of the image -sensor surface, in a 
locus— dependent manner. Coating 24 is made of a suitable 
material, as mentioned earlier. In addition to an always 

25 present wavelength-dependent characteristic, the filter effect 
may also have a locus -dependent characteristic, which is 
achieved by applying various coatings at different locations, 
for example - 

With regard to the local filter characteristic. Figure 5 shows 
30 the local intensity distribution of the low-beam light from 

the camera's perspective- Boxes 19 and 19' drawn in gray mark 
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the approximate close range and thus the position and size of 
optical filter 9 (to be affixed inversely) . It can be seen 
clearly that the filter need not necessarily take up the 
entire width of the image sensor. 

5 Since filter 9 (not shown in Figure 5) should exhibit an 

inverse characteristic of the intensity in order to generate 
an image having the most uniform brightness for the driver, 
the following applies: 

The filter is configured not to provide attenuation for dark 
10 regions, and filter 9 is to provide strong attenuation for 

bright areas . The brightness stages lying in-between should be 
imaged continuously, if possible, in an inverse manner as 
well . 

The locally varying attenuation and the stepless variation, if 
15 possible, of the transmittance capacity of filter 9 is able to 
be realized in different ways. 

For one, it may be achieved by a locally varying application 
of a different number of attenuation layers having the same 
transmissivity . 

2 0 One attenuation layer has a transmissivity of 95%, for 

example- If five layers, for instance, are then applied on top 
of one another, one obtains an overall transmittance of 95% to 
the power of 5 = 77%. The different number of layers at 
different locations may be realized by masks or multiple 

25 coatings, for example . 

For another, it may be achieved by a locally varying 
application of different layers having different 
transmissivity. In this manner, layers having transmissivities 
of 95%, 90%, 85% for example, are applied one after 
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another using a plurality of masks that do not overlap. 
The two methods may also be combined. 

Although the present invention was described above in terms of 
exemplary embodiments, it is not limited to these embodiments, 
5 but rather may be modified in numerous ways. 

For instance, the optical filter may already be affixed in the 
optical path of the night -vision system in front of the 
camera. A partially filtering coating of the windshield, for 
instance, is conceivable. 
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